A pervasive conversational interface for information interaction
نویسندگان
چکیده
In this paper, we describe a new pervasive conversational system that provides access to multiple desktop applications, from multiple client devices, using multiple input modalities. Client devices currently supported include desktop and telephone, and the applications incorporated include email, calendarand address book. When the access is from a desktop, both conversational natural language and graphical inputs are supported. The paper describes the overall architecture to support such a pervasive conversational system, along with innovations in continuous speech recognition, statistical natural language understanding, and dialog management that were developed to build the system. The paper also describes the partially unsupervised Wizard-of-Oz style setup to collect real-use data, and the performance of the statistical models constructed using this data for speech recognition and natural language understanding.
منابع مشابه
Multimodal and mobile conversational Health and Fitness Companions
Multimodal conversational spoken dialogues using physical and virtual agents provide a potential interface to motivate and support users in the domain of health and fitness. In this paper we present how such multimodal conversational Companions can be implemented to support their owners in various pervasive and mobile settings. We present concrete system architectures, virtual, physical and mob...
متن کاملUbiquitous Access to Unified Messaging: A Study of Usability and the Use of Pervasive Computing
The advent of mobile devices and the wireless Internet is having a profound impact on the way people communicate, as well as on the user interaction paradigms used to access information that was traditionally accessible only through visual interfaces. Applications for mobile devices entail the integration of various data sources optimized for delivery to limited hardware resources and intermitt...
متن کاملSmall Talk and Conversational Storytelling in Embodied Conversational Interface Agents
People engage in small talk and conversational storytelling to provide information in engaging ways and to serve interpersonal goals such as building rapport and credibility. Embodied conversational interface agents, that represent the computer in its interaction with human users by way of a graphical humanoid body on a screen, can also profitably engage in these behaviors. We describe the ongo...
متن کاملSystem Architectures for Speech-based and Multimodal Pervasive Computing Applications
Speech-based and multimodal interaction can be very efficient and natural way for human-computer communication in pervasive computing settings. The key features in these settings are the distributed and adaptive nature of interaction. In order to implement applications efficiently the system architecture must support these features. In this paper we discuss the requirements for speech-based per...
متن کاملStructuring collaborative information-seeking dialogues
Conversational approaches to human-computer collaboration have so far mostly been employed for the design of natural language interfaces. We claim, however, that our “conversational interaction model” can also be applied feasibly to graphical and multimodal interactions. The model comprises two interrelated parts: first, the description of local discourse structures and functional interrelation...
متن کامل